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Abstract 

In these lectures I will review some theoretical results that have been obtained for spin 
glasses. I will concentrate my attention on the formulation of the mean field approach 
and on its numerical and experimental verifications. I will present the various hypothesis 
at the basis of the theory and I will discuss their mathematical and physical status. 

1 Introduction 

Spin glasses have been intensively studied in the last thirty years. They are very interesting 
for many reasons: 

• Spin glasses are the simplest example of glassy systems. There is a highly non-trivial 
mean field approximation where one can study phenomena that have been discovered 
for the first time in this context, e.g. the existence of many equilibrium states and the 
ultrametricity relation among these states. In this framework it is possible to derive some 
of the main properties of a generic glassy systems, e.g. history dependent response [HEllS]; 
this property, in the context of mean field approximation, is related to the existence of 
many equilibrium states^ 

• The study of spin glasses opens a very important window for studying off-equilibrium 
behavior. Aging [9j and the related violations of the equilibrium fluctuation dissipation 
relations emerge in a natural way and they can be studied in this simple setting flUl [TT| 
|T2[ [13]. Many of the ideas developed in this context can be used in other physical fields 
like fragile glasses, colloids, granular materials, combinatorial optimization problems and 
for other complex systems 

^This sentence is too vague: one should discuss the its precise mathematical meaning; although we will 
present in these lecture a physically reasonable definition, for a careful discussion see ref. [11 [5l [6l [71 [8j . 
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• The theoretical concepts and the tools developed in the study of spin glasses are based 
on two logically equivalent, but very different, methods: the algebraic broken replica 
symmetry method and the probabilistic cavity approach [21 [3]. They have a wide domain 
of applications. Some of the properties that appear in the mean field approximation, like 
ultrametricity, are unexpected and counterintuitive. 

• Spin glasses also provide a testing ground for a more mathematical inclined probabilistic 
approach: the rigorous proof of the correctness of the solution of the mean field model 
came out after twenty years of efforts where new ideas (e.g. stochastic stability [T^ tfTBlfTT] ) 
and new variational principles [THI iT9j were at the basis of a recent rigorous proof [20] 
of the correctness of the mean field approximation for in the case of the infinite range 
Sherrington-Kirkpatrick model [2T] . 

In these lectures I will present a short review of some of the results that have been obtained 
using the probabilistic cavity approach. I will mostly discuss the mean field approximation for 
the infinite range Sherrington-Kirkpatrick. I will only mention en passant how to extend these 
results to finite connectivity model and to finite dimensional systems. The very interesting 
applications of these techniques to other problems coming from physics (e.g. glasses [22]) and 
other disciplines [H] will not be discussed. 

2 General considerations 

The simplest spin glass Hamiltonian is of the form: 

H= •Ji^kO'iCrk, (1) 

i,k=l,N 

where the J's are quenched (i.e. time independent) random variables located on the links 
connecting two points of the lattice and the cr's are Ising variables (i.e. they are equal to ±1). 
The total number of points is denoted with and it goes to infinity in the thermodynamic 
limit. 

We can consider four models of increasing complexity: 

• The SK model [21]: All J's are random and different from zero, with a Gaussian or a 
bimodal distribution with variance N~^^'^. The coordination number (z) is — 1 and it 
goes to infinity with A^. In this case a simple mean field theory is valid in the infinite A^ 
limit [313]. 

• The Bethe lattice model [231 EH [25]: The spins live on a random lattice and only Nz/2 
J's are different from zero: they have variance The average coordination number 
is finite (i.e. z). In this case a modified mean field theory is valid. 

• The large range Edwards Anderson model ^26j: The spins belong to a finite dimensional 
lattice of dimension D. Only nearest spins at a distance less than R interact and the 
variance of the J's is proportional to l/R^/"^. If R is large, the corrections to mean 
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field theory are small for thermodynamic quantities, although they may change the large 
distance behavior of the correlations functions and the nature of the phase transition, 
which may disappear. 

• The Edwards Anderson model ^27j: The spins belong to a finite dimensional lattice of 
dimensions D: Only nearest neighbor interactions are different from zero and their vari- 
ance is D^^^^ . In this case finite corrections to mean field theory are present, that are 
certainly very large in one or two dimensions, where no transition is expected. The Ed- 
wards Anderson model corresponds to the limit i? = 1 of the the large range Edwards 
Anderson model; both models are expected to belong to the same universality class. The 
large range model Edwards Anderson provides a systematic way to interpolate between 
the mean field results and the short range model 0. 

As far as the free energy is concerned, one can prove the following rigorous results: 

lim Bethef^) = SK , (2) 
lim Edwards Anderson(i5) = SK , 
lim finite range EA(/2) = SK . 

The Sherrington Kirkpatrick model is thus a good starting point for studying also the finite 
dimensional case with short range interaction, that is the most realistic and difficult case. This 
starting point becomes worse and worse when the dimension decreases, e.g. it is not any more 
useful in the limiting case where D = 1. 



3 Mean field theory 
3.1 General considerations 

Let us start again with the Hamiltonian in eq. ^ and let us proceed in the most naive way. 
Further refinements will be added later. 

We consider the local magnetizations irii = (ai) and we write the simplest possible form of 
the free energy as function of the magnetization. Using the standard arguments, that can be 
found in books [5], we get: 

F[m\= Ji,kfnimk-TYS{mi) , (3) 

i,k=l,N i 

where S'(m) is the usual binary entropy: 

1/1+m /l + m\ 1-m /l-m\\ 
-^M = 2(^log(^j + ^log(^jj • 

^In a different approach one introduces ly spins per site that are coupled to all the spins in the nearest points 
of the lattice. It is possible formally to construct an expansion in the parameter g = the so called loop 
expansion. 
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If we look to the minimum of the free energy, we get the following equations (that are valid at 
any stationary point of the free energy): 

rrii = th.{hf^), hf^ = ^ Ji^kC^k ■ (5) 

k 

This is well known and fifty years ago we could have stopped here. However now we 
understand that mean field approximation involves uncontrolled approximations and therefore 
we need to work in a more controlled framework. 

In a more modern approach one consider a model and one tries to write down an expression 
for the free energy that is exact for that particular model. In this way one is sure that the 
range of validity of the formulae one is writing is not void (and what is more important, if no 
technical mistakes have been done, there could be no contradictions). As far as the exact model 
is often obtained as limit of a more realistic model when some parameter goes to infinity, it is 
possible to estimate the corrections to these asymptotic results. 

A very interesting case, where usually mean field exact formula are valid, happens when 
the coordination number (i.e. the number of spins that are connected to a given spin) goes 
to infinity. Let us consider the following construction. We assume that for a given i, Ji ^ is 
different from zero only for z different values of k (for simplicity let us also assume that the J's 
take only the values ±1 with equal probability). 

We are interested to study the limit where z goes to infinity. One can immediately see that 
in the random case a finite result is obtained (at least in the high temperature phase) only if 
J goes to zero as z'^^"^ (a similar result can be obtained also in the low temperature phase). 
This result is in variance with the ferromagnetic case where the J's are all positive and they 
should go zero as z in order to have a finite result in the low temperature phase. Indeed a good 
thermodynamic scaling is present when h'^^^ is of 0(1). In the ferromagnetic case the z terms in 
the expression for h'^^^ add coherently and therefore each of them must be of order z~^\ on the 
contrary in the spin glass case, if they are uncorrelated (this is true in a first approximation), 
h^ff is the sum of z random terms and the result is of 0(1) only if each term is of order 

If one makes a more careful computation and we look to the corrections to the mean field 
expression that survive in this limit, one obtains: 

FTAp[m] = (6) 
E (7;Ji,kmimk - -/3Jl,^{l - m^i){l - ml)j -T^5(mi) , 

i,k=l,N \^ ^ / i 

where (5 = 1/T (we put the Boltzmann-Drude constant a to the value 3/2). 

This free energy has an extra term with respect to the previous free energy eq. ([5]) and is 
called the TAP free energy [28] . because it firstly appeared in a preprint signed by Thouless, 
Anderson, Lieb and Palmer 1^. The extra term can be omitted in the ferromagnetic case, because 
it gives a vanishing contribution. 

We must add a word of caution: the TAP free energy has not been derived from a variational 
equation: the magnetization should satisfy the the stationary equation: 

dF 

dnij ' ^ ^ 



^There are other possible terms, for example ^ Jfu^ki'^fi^ but they do vanish in this limit. 
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but there is no warranty that the correct value of the magnetization is the absolute minimum 
of the free energy. Indeed in many cases the paramagnetic solution (i.e. rrii = 0) is the absolute 
minimum at all temperatures, giving a value of the free energy density that would be equal 
to The corresponding internal energy would be equal to — it would give an result 

divergent at T = 0, that in most of the cases would be unphysical. 

Let us be more specific (although these consideration are quite generic) and let us consider 
the case of the Sherrington Kirkpatrick model, where all spins are connect and z = N — 1. 

Here one could be more precise and compute the corrections to the TAP free energy: an 
explicit computation shows that these corrections are not defined in some regions of the mag- 
netization space [H [29]. When the corrections are not defined, the TAP free energy does not 
make sense. In this way (after a detailed computation) one arrives the conclusion that one 
must stay in the region where the following condition is satisfied: 

/32Av((l-m,2)2) <1, (8) 

where Av stands for the average over all the points i of the sample. When the previous 
relation is not valid, one finds that the correlations function, that were assumed to be negligible, 
are divergent [2J and the whole computation fails. The correct recipe is to find the absolute 
minimum of the TAP free energy only in this region [1]. Of course the paramagnetic solution 
is excluded as soon as T < 1. 

Let us as look to the precise expression of the TAP stationarity equations: they are 

= thm^f) , hf^ = {Jr,kmk - Pm^Jlil - ml)) . (9) 

k 

For large N these equations can be simplified to 

hi = Yl {JiM^k - Prriiil - Qea)) , (10) 

k 

where 

qea = Av(m2) . (11) 

Apparently the TAP equations are more complex that the naive ones ([5]); in reality their 
analysis is simpler. Indeed, using perturbation expansion with respect to the term Jj that are 
of order 0{N^/^), we can rewrite the effective field as 

ht" = E J^,kml , (12) 

k 

where the cavity magnetizations are the values of the magnetizations at the site A; in a system 
with — 1 spins, where the spin at i has been removed [2j (the correct notation would be ml.- 
in order to recall the dependence of the cavity magnetization on the spin that has removed, but 
we suppress the second label i when no ambiguities are present). The previous equations are 
also called Bethe's equations because they were the starting point of the approximation Bethe 
in his study of the two dimensional Ising model. 

The crucial step is based on the following relation: 

mk = ml + (3miJi^k{l - {ml-if) . (13) 
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This relation can be proved by using the fact that the local susceptibility drrii/dhi is given by 
j3{l — m^) in the mean field approximation. Although the difference between m{k) and is 
small, i.e. 0(A^^^/^), one obtains that the final effect on h^ff is of 0(1). 

The validity of eq. (1121) is rather fortunate, because in this formula Jj ^ and m| are uncorre- 
lated. Therefore the central limit theorem implies that, when one changes the Jj^/., the quantity 
h1^^ has a Gaussian distribution with variance Qea- Therefore the probability distribution of 
/^e// jg given by 

P{h)dh = (27r)-i/2 exp(-gV2)rf/i = rf/ig(/i) (14) 

However this result is valid only under the hypothesis that there is a one to one correspon- 
dence of the solutions of the TAP equation at and at A^ — 1, a situation that would be 
extremely natural if the number of solutions of the TAP equations would be a fixed number 
(e..g 3, as happens in the ferromagnetic case at low temperature). As we shall see, this may be 
not the case and this difference brings in all the difficulties and the interesting features of the 
models. 

3.2 The cavity method: the naive approach 

Given the fact that all the points are equivalent, it is natural to impose the condition that 
the statistical properties of the spin at z, when the Jj ^ change, are i independent. For a large 
system this statistical properties coincide with those obtained by looking to the properties of 
the other A^ — 1 spins of the system. This condition leads to the cavity method, where one 
compare the average properties of the spins in similar systems with slightly different size. 

The cavity method is a direct approach that in principle can be used to derive in an prob- 
abilistic way all the results that have been obtained with the replica method 0. The replica 
approach is sometimes more compact and powerful, but it is less easy to justify, because the 
working hypothesis that are usually done cannot be always translated in a transparent way in 
physical terms 0. 

The idea at the basis of the cavity method is simple: we consider a system with A^ spins 
{i = 1, A^) and we construct a new system with A^ + 1 spins by adding an extra spin (ctq). We 
impose the consistency condition that the average properties of the new spin (the average being 
done with respect to Jo,i) are the same of that of the old spins [2], |2^ . 

In this way, if we assume that there is only one non-trivial solution to the TAP equations [§, 
we get that for that particular solution 

rriQ = Av(m^) , (15) 

where the bar denotes the average over all the Jo,i. 

^The replica method is based on a saddle point analysis of some n dimensional integral in the limit where n 
goes to zero. 

^ Not all the results of the replica approach have been actually derived using the cavity approach, although 
in principle it shuold be possible to do so. 

^We neglect the fact the if rm is a particular solution of the TAP equations, also —mi is a solution of the 
TAP equations. This degeneracy is removed if we add an infinitesimal magnetic field or we restrict ourselves 
only the half space of configurations with positive magnetization. 
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The Hamiltonian of the new spin is: 



i=l,N 

If we suppose that the spins cxj have vanishing correlations and we exploit the fact that each 
individual term of the Hamiltonian is small, we find that 

mo = (ao) = tanh(/?/i"^-^) . (17) 



c 



where m\ (for i 7^ 0) denotes the magnetization of the spin Oi before we add the spin 0. In 
this way we have rederived the TAP equations for the magnetization in a direct way, under the 
crucial hypothesis of absence of long range correlation among the spins (a result that should 
be valid if we consider the expectation values taken inside one equilibrium state). It should be 
clear why the whose approach does not make sense when the condition eq. ([8]) is not satisfied. 

We have already seen that when the variables Jo,i are random, the central limit theorem 
implies that /i is a Gaussian random variable with variance 

= Qea = j;^ , (18) 



and the distribution probability of h is given by eq. ( fT4|) . The same result would be true also 
when the variables are random. 

If we impose the condition that the average magnetization squared of the new point is equal 
to average over the old points, we arrive to the consistency equation: 

qea = ml = J d^q^^Qi) tanh^(/?/i) , (19) 

where d^qj^^iji) denotes a normalized Gaussian distribution with zero average and variance 
qEA- It is easy to check [2] that the /i-dependent increase in the total free energy of the system 
(when we go from to + 1) is 

/?AF(/i) = -ln(cosh(/3/i)) . (20) 

It is appropriate to add a comment. The computation we have presented relates the mag- 
netization a spin of the systems with A^ + 1 spins to the magnetizations of the system with A^ 
spins: they are not a closed set of equations for a given system. However we can also write 
the expression of magnetization at the new site as function of the magnetizations of the system 
with A^ + 1 spins, by computing the variation of the magnetizations in a perturbative way. Let 
us denote by m the magnetization of the old system (A^ spins) and by m' the magnetization of 
the new system (A^ + 1 spins). Perturbation theory tell us that 

m[^mi + Jo,imQ-^ = rrii + Jo,i"^o/5(l - {m'if) . (21) 
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It is not surprising that using the previous formula we get again the TAP equations [281 12] : 

rriQ = tanh(/5/i) 

h= Jo.rrii'^ JoM-KY.JlA^-0 (22) 

i=l,N i=l,N i 

i=l,N 

where (iV + l)^^^) = Si=o,Af (we have used the relation Jq ^ = A^"-'^). 

A detailed computation show that the free energy corresponding to a solution of the TAP 
equations is given by the TAP free energy. The computation of the total free energy is slightly 
tricky. Indeed we must take care than if we just add one spin the coordination number z change 
and we have to renormalize the J's. This gives an extra term that should be taken into account. 

The explicit computation of the free energy could be avoided by computing the internal 
energy density and verifying a a posteriori the guessed form of the free energy is correctly 
related to the internal energy. Here we can use a general argument: when the J's are Gaussianly 
distributed the internal energy density e is given 



e = 2 1] JoA^^oCTi) = = (23) 

/?^E((K^^W^K^ = - q') ■ 

i 

In the first step we have integrated by part with respect to the Gaussian distribution of the J, 
in the last step se have used the assumption that connect correlation are small and therefore 

{aQGif ^ {moniiY . (24) 

In both ways one obtain the expression for the TAP free energy, where the only parameter free 
is g = qea] we can call this quantity f{q); its explicit expression is 

f^fiq) = -<f)+ j d^^.ih) In {cosH(3h)) (25) 

The value of q can be computed in two mathematical equivalent ways: 

• We use the equation f|T9l) to find a non-linear equation for q. 

• We find the stationary point of the free energy respect to q by solving the equation 
df/dq = 0. 

An integration by part is the needed step to prove the equivalence of the two computations. 

An explicit computation shows that the non-trivial stationary point (i.e q ^ 0), that should 
be relevant at T < 1, is no not a minimum of the free energy, as it should be a maximum for 
reasons that would be clear later. In this way one finds the form of the function q{T). which 
turns out to be rather smooth: 
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• q{T) is zero for T > 1. 

• q{T) it is proportional to 1 — T for T slightly below 1. 

• q{T) behave as 1 — AT , with positive A when T goes to zero. 

When this solution was written down [2JLJ, it was clear that something was wrong. The total 
entropy was negative at low temperature. This was particular weird, because in usual mean 
field models the entropy is just the average over the sites of the local entropy that is naturally 
positive. The villain is the extra term that we have added to the naive free energy in order to 
get the TAP free energy: indeed one finds that the entropy density is given by 

S = Av{S{m,)) - ^-^^f- . (26) 

The average of the local term goes like T at low temperatures, while the extra term goes to 
—A'^/4, i.e. -0.17. It is important to note that the extra term is needed to obtain that for 
T > 1, e = — /3/2, a results that can be easily checked by constructing the high temperature 
expansion. 

On the contrary numerical simulations [21] showed a non-negative entropy (the opposite 
would be an extraordinary and unexpected event) very similar to the analytic computation for 
T > 0.4 and going to zero at (the analytic result was changing sign around T = .0.3). 

Also the value of the internal energy was wrong: the analytic computation gave e = —0.798 
while the numerical computations gave e = —0.765 ± 0.01 (now numerical simulations give 
e = -0.7633 ±0.0001). 

It is clear that we are stacked, the only way out is to leave out the hypothesis of the existence 
of only one solution of the TAP equations (or equivalently of only one equilibrium state) and 
to introduce this new ingredient in the approach. This will be done in the next section. 

4 Many equilibrium states 

4.1 The definition of equilibrium states 

The origin of the problem firstly became clear when De Almeida and Thouless noticed that in 
the whole region T < 1, the inequality ([8]) was violated: 

P'Ay ((1 - m^Y) = 1 + Boil - Tf , (27) 

with Bq positive. 

The problem became sharper when it was rigorously proved that the wrong naive result was 
a necessary consequence of the existence of a only one equilibrium state, i.e. of the assumption 
that connected correlations functions are zero (in an infinitesimal magnetic field) and therefore 

(a.^fc) ^ . (28) 

In order to develop a new formalism that overcomes the pitfalls of the naive replica approach, 
it is necessary to discuss the physical meaning of these results and to consider the situation 
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where many states are present. The first step consists in introducing the concept of pure states 
in a finite volume [21 [6] . This concept is crystal clear from a physical point of view, however it is 
difficult to state it in a rigorous way. We need to work at finite, but large volumes, because the 
infinite volume limit for local observables is somewhat tricky and we have a chaotic dependence 
on the size [H [0] . 

At this end we consider a system with a total of N spins. We partition the equilibrium 
configuration space into regions, labeled by a, and each region must carry a finite weight. We 
define averages restricted to these regions [3 O |6] : these regions will correspond to our finite 
volume pure states or phases. It is clear that in order to produce something useful we have 
to impose sensible constraints on the form of these partitions. We require that the restricted 
averages on these regions of phase space are such that connected correlation functions are small 
when the points are different in an infinite range model. This condition is equivalent to the 
statement that the fluctuation of intensive quantities vanishes in the inflnite volume limit 
inside a given phase. 

The phase decomposition depends on the temperature. In a ferromagnet at low temperature 
two regions are deflned by considering the sign of the total magnetization. One region includes 
conflgurations with a positive total magnetization, the second selects negative total magnetiza- 
tion. There are ambiguities for those conflgurations that have exactly zero total magnetization, 
but the probability that these conflgurations are present at equilibrium is exponentially small 
at low temperature. 

In order to present an interpretation of the results we assume that such decomposition exists 
also each instance of our problem. Therefore the finite volume Boltzmann-Gibbs measure can 
be decomposed in a sum of such flnite volume pure states and inside each state the connect 
correlations are small. The states of the system are labeled by a: we can write 



(29) 



a 



with the normalization condition 



(30) 



a 



where e — > when — ^> oo. 

The function Pj{q) for a particular sample is given by 



a, 13 



(31) 



where qa,'y is the overlap among two generic conflgurations in the states a and 7: 



_ El=l,jv"^a(0"^7(0 



(32) 



and ma{i) and m^{i) are respectively the magnetizations within the state a and 7. 



^ Intensive quantities are defined in general as 6 = Si^i , where the functions Bi depend only on the 
value of Ui or from the value of the nearby spins. 
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For example, if we consider two copies (i.e. a and r) of the same system, we have; 



A = -j;^ (33) 

and 

{g{q[a,T]))j = j g{q)Pj{q)dq , (34) 

where g{q) is a generic function of q. 

Given two spin configurations (cr and r) we can introduce the natural concept of distance 

by 

1 ^ 

d\^,r)^—YX^,-T;)\ (35) 

that belongs to the interval [0-2], and is zero only if the two configurations are equal (it is 
one if they are uncorrelated) . In the thermodynamical limit, i.e. for — > oo, the distance 
of two configurations is zero if the number of different spins remains finite. The percentage of 
different a's, not the absolute number, is relevant in this definition of the distance. It is also 
important to notice that at a given temperature when goes to infinity, the number of 
configurations inside a state is extremely large: it is proportional to exp(A^S'(/?)), where S{f5) 
is the entropy density of the system). 

In a similar way we can introduce the distance between two states defined as the distance 
among two generic configurations of the states: 



In the case where the self-overlap 



c^L = 1 - ^«.7 • (36) 



qa,a = j;^ , (37) 



does not depend on a and it is denoted by qEA, "we have that the distance of a state with itself 
is not zero: 

dl,a = l-qEA ■ (38) 

We expect that finite volume pure states will enjoy the following properties that hopefully 
characterizes the finite volume pure states [6l [7] : 

• When is large each state includes an exponentially large number of configurations |^. 

• The distance of two different generic configurations Ca and C-y (the first belonging to state 
a and the second to state 7) does not depend on the Ca and C^, but only on a and /3. The 
distance da^^y among the states a and 7, is the distance among two generic configurations 



^We warn the reader that in the case of a glassy system it may be not possible to consider iV — > 00 limit of 
a given finite volume pure state: there could be no one to one correspondence among the states at N and those 
at 2N due to the chaotic dependence of the statistical expectation values with the size of the system [4] . 
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in these two states. The reader has aheady noticed that with this definition the distance 
of a state with itself is not zero. If we want, we can define an alternative distance: 

in such a way that the distance of a state with itself is zero {Da^a = 0). 

• The distance between two configurations belonging to the same state a is strictly smaller 
than the distance between one configuration belonging to state a and a second configu- 
ration belonging to a different state 7. This last property can be written as 



da,a < da^-y if a 7^ 7 . (40) 

This property forbids to have different states such that D^^^ = 0, and it is crucial in 
avoiding the possibility of doing a too fine classification [^. 

• The classification into states is the finest one that satisfies the three former properties. 

The first three conditions forbid a too fine classification, while the last condition forbids a 
too coarse classification. 

For a given class of systems the classification into states depends on the temperature of the 
system. In some case it can be rigorously proven that the classification into states is possible 
and unique [301 EI] (in these cases all the procedures we will discuss lead to the same result). 
In usual situations in Statistical Mechanics the classification in phases is not very rich. For 
usual materials, in the generic case, there is only one state. In slightly more interesting cases 
there may be two states. For example, if we consider the configurations of a large number 
of water molecules at zero degrees, we can classify them as water or ice: here there are two 
states. In slightly more complex cases, if we tune carefully a few external parameters like the 
pressure or the magnetic field, we may have coexistence of three or more phases (a tricritical 
or multicritical point). 

In all these cases the classification is simple and the number of states is small. On the 
contrary in the mean field approach to glassy systems the number of states is very large (it 
goes to infinity with A^), and a very interesting nested classification of states is possible. We 
note "en passant" that this behavior implies that the Gibbs rule is not valid for spin glasses. 

We have already seen the only way out from the inconsistent result of the naive approach 
is to assume the existence of many equilibrium states. A more precise analysis will show that 
we need not only a few equilibrium states but an infinite number and which are the properties 
of these states. 

^For example if in a fcrromagnct (in a witless mood) we would classify the configurations into two states 
that we denote by e and o, depending if the total number of positive spins is even or odd, we would have that 

^°The Gibbs rule states that in order to have coexistence of K phases (iiT-critical point), we must tune K 
parameters. In spin glasses no parameters are tuned and the number of coexisting phases is infinite! 
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4.2 The description of a many states system 

The next step consists in describing a system with many equihbrium state and to find out 
which is the most appropriate way to code the relevant information, 
Let us assume that a system has many states. In equation 

(■) = E^«(-)- (41) 

a 

there is a large number of w's that are non-zero. 

How are we are supposed to describe such a system? First of all we should give the list of 
the Wa- In practice it is more convenient to introduce the free energy of a state defined by 

oc exp(-/5F„) , (42) 

where the proportionality constant is fixed by the condition of normalization of the w's, i.e. eq. 
(1301) . Of course the free energies are fixed modulo an overall addictive constant, 

The second problem it to describe the states themselves. In this context we are particularly 
interested in describing the relations among the different states. At this end we can introduce 
different kinds of overlaps: 

• The spin overlap, which we have already seen, i.e. 

?«,7 = ^"'E(^i)"(^i)7 • (43) 
i 

• The link (or energy) overlap, which is defined as: 

Ian = E JiA(^i(^k)aJi,k{^i<yk)^ ■ (44) 

i,k 

• We could introduce also more fancy overlaps like 

??7 = E 42 {^^^k), , (45) 

i,k 

where J^'-* denotes the /-th power of the matrix J. 

• More generally, in the same way as the distances we can introduce overlaps that depend 
on the local expectation value of an operator 0{i) 

QL':^=N^'j:m))a{o{z)),, (46) 

i 

In principle the description of the system should be given by the list of all Fa and by the list of 
all possible overlaps a between all the pairs a, 7. However it may happens, as it can be argued 
to happen in the SK model, that all overlap are function of the same overlap q. For example 
in the SK model we have 

q^ = q'. (47) 
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More complex formulae holds for the other overlaps. 
In the case in short range model we may expect that 



= l{q') 



(48) 



where l{q) is a model (and temperature) dependent function [32| [33] 

If this reductio ad unum happens, we say that we have overlap equivalence and this is a 
property that has far reaching consequences. The simplest way to state this properties is the 
following. We consider a system composed by two replicas (a and r) and let us denote by 
the usual expectation Boltzmann-Gibbs expectation value with the constraint that 



Overlap equivalence states that in this restricted ensemble of the connected correlation functions 
of the overlap (and of the generalized overlaps) are negligible in the infinite range case (they 
would decay with the distance in a short range model). 

There is no a priori compulsory need for assuming overlap equivalence; however it is by far 
the simplest situation and before considering other more complex cases it is better to explore 
this simple scenario, that it is likely to be valid at least in the SK model. 

If overlap equivalence holds, in order to have a macroscopic description of the system, we 
must know only the list of all and the list of al g^^^. As we have already mentioned, we can 
also assume that for large N ^ does not depend on a and it is equal to qea (this property 
is a consequence that the states cannot be distinguished one form the other using intrinsic 
properties). At the end the high level description of the system is given by [U [TSj: 



where the indices a and 7 goes from 1 to ^{N), where Q{N) is a function that goes to infinity 
with A^. The precise way in which ^(A^) increases with A^ is irrelevant because all high free 
energy states give a very small contribution to statistical sums. 

In a random system the descriptor T) is likely to depend on the system 0, therefore we 
cannot hope to compute it analytically. The only thing that we can do is to compute the 
probability distribution of the descriptor V{D). Some times one refer to this task as high level 
statistical mechanics [7] because one has to compute the probability distribution of the states of 
the system an not of the configurations, as it is done in the old bona fide statistical mechanics 
(as it was done in the low level statistical mechanics). 

4.3 A variational principle 

Low level and high level statistical mechanics are clearly intertwined, as it can be see from 
the following considerations, where one arrives to computing the free energy density of the SK 
model using a variational principle. 

-'^-'^In a glassy non-random system it is quite possible that there is a strong dependence of V on the size N of 
the system. 



g[a, r] = g . 



(49) 



= {Qea, {Fa}, {qa,-/}} 



(50) 
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Here we sketch only the main argument (the reader should read the original papers [HI [19]). 
Here for simplicity we neglect the terms coming for the necessity of renormalize the J when we 
change A^; these terms can be added at the price of making the formalism a little heavier. 

Let us consider an SK system with particles with a descriptor V^^. If we add a a new 
site we obtain a descriptor Pat+i where the overlaps do not change and the new free energies 
are given by 

F^{N + 1) = F„(Ar) + AF„, /3AF„ = - ln(cosh(/3/i,)) (51) 

where 

ha = Y^ Jo,imaii) . (52) 

i 

Also in the case where the are Gaussian random uncorrelated, the fact that the new free 
energy depends on implies that at fixed value of the free energy Fa{N + 1) the correspond- 
ing value of the old free energy Fa{N) is correlated with ha- It is a problem of conditioned 
probability. If we look at the distribution of h^, conditioned at the value of the old free energy 
Fa{N), we find a Gaussian distribution, but if we look to the same quantity, conditioned at 
the value of Fa{N + 1), the distribution is no more Gaussian. Therefore if we extract a state 
with a probability proportional to Wa oc exp{—(3Fa{N + 1)) the distribution of ha will be not 
Gaussian. 

Now it is clear that the ha (conditioned to the old values of the free energy) are random 
Gaussian correlated variables because 

hah^ = (Ja,^ ■ (53) 

This correlation induces correlations among the AF^. 

Let us suppose for simplicity that we have succeeded in finding a choice of V(V) that is 
self-reproducing, i.e. a probability distribution such that 

Vn+i{V) = Vn{V) . (54) 

We have neglect an overall shift AF{V) of the free energies, that obviously depend on V. The 
self-reproducing property is non-trivial as we shall see later. Notice than in going from to 
+ 1 the g's do not change, so the crucial point are the correlations among the g's and the 
F's that may change going form A^ to A^ + 1. 

A very interesting variational principle [19] tell us that the true free energy density / is 
given by 

/ = maxAF(P), (55) 

which automatically implies that 

/ > AF{V) VP . (56) 

The reader should notice that there are no typos in the previous formulae. The free energy is 
the maximum, and not the minimum, with respect to all possible probabilities of the descriptor. 
It is difficult to explain why these inequalities are reversed with respect to the usual ones. 

We could mumble that in random system we have to do the average over the logarithm of 
the free energy and the logarithm has the opposite convexity of the exponential. This change 
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of sign is very natural also using the replica approach, but it is not trivial to give a compulsory 
physical explanation. The only suggestion we can give is follow the details of the proof. 

The mathematical proof is not complex, there is a simpler form of this inequality that has 
been obtained by an interpolating procedure by Guerra [TS] that is really beautiful and quite 
simple (it involves only integration by part and the notion that a square in non-negative). 

We must add a remark: although the theorem tells us that the correct value of the free 
energy is obtained for a precise choice of the probability V*{T>) that maximize eq. fl55l) . there 
is no warranty that the actual form of the probability of the descriptors is given by V*{T>). 
Indeed the theorem itself does not imply that the concept of descriptor is mathematical sound; 
all the heuristic interpretations of the descriptor and of the meaning of the theorem is done at 
risk of the physical reader. 

While the lower bound is easy to use, for particular cases it coincides with Guerra's one |18j . 
in this formalism it is particularly difficult to find a V{T>) such that it is the actual maximum. 
The only thing that we are able to do is to prove by other means [20] which is the value of / 
and to find out a V*(V) that it saturate the bounds 0. It uniqueness (if restricted to the class 
of functions that satisfy eq. is far from being established. It is clear that we miss some 

crucial ingredient in order to arrive to a fully satisfactory situation. 

5 The explicit solution of the Sherrington Kirkpatrick 
model 

5.1 Stochastic Stability 

The property of stochastic stability was introduced in a different context flEi [T6| [T7] , however it 
is interesting to discuss them in this perspective. Stochastic stability stability is crucial because 
it strongly constrains the space of all possible descriptors and it is the hidden responsible of 
most of the unexpected cancellations or simplifications that are present in the computation of 
the explicit solution of the Sherrington Kirkpatrick model. 

Let us sketch the definition of stochastic stability in this framework. Let us consider a 
distribution V{T>) and let us consider a new distribution V'{T>) where 

F'^ = F^ + r^. (57) 

Here the r's are random variables such that the correlation among Tq, and is a function of 
only 

'?a,7- We say that the distribution is stochastically stable iff the new distribution is equal 
to the previous one, after averaging over the r's, apart from an overall shift or the F's, i.e. iff 

ViV) = V\V) . (58) 

It is evident that, if a distribution is stochastically stable, it is automatically self-reproducing 
because the the shifts in free energy can be considered random correlated variables. This 
strongly suggest to consider only stochastic stable cP{T>). Moreover general arguments, that 
where at the origin of the first version of stochastic stability [151 [161 [17] imply that V{T>) should 
be stochastically stable. 
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More precisely the original version of stochastic stability implies the existence of a large set 
of sum rules, which can be derived in this context if we assume that the equation (1581) is valid. 
These sum rules give relations among the joint average of the overlap of more real replicas 
(i.e. a finite number of copies of the system in the same realization of the quenched disorder). 
One can show [31] that under very general assumptions of continuity that also valid in finite 
dimensional models for the appropriate quantities. 

These relations connects the expectation values of products of various functions Pj{q) to 
the expectation value of the function Pj{q) itself. 

An example of these relations is the following 

P{q) = PAq ) , 

P{q,^2, g3,4) = PAqi,2)Pj{qzA) = (59) 
2 1 

2^(51,2)^(^3,4) + g^(gi,2)5(gi,2 - ^3,4) • 

where we have denoted by an bar the average over the J's. 

This relation is difficult to test numerically, as far as in finite volume systems we do not 
have exact delta functions, therefore very often one test simplified versions of these equations. 
For example let us consider four replicas of the system (all with the same Hamiltonian) and we 
denote by 

E{...)^Xr7) (60) 

the global average, taken both over the thermal noise and over the quenched disorder. The 
previous equation implies that 

E{qUh) = \E{ql,f + \E{ql,) , (61) 

This relation is very interesting: it can be rewritten (after some algebra), in a slightly different 
notation as 

[{A) J - = \{{A-{A)jf)j , (62) 

with A = q^. This relation implies that the size of sample to sample fluctuations of an observable 
(l.h.s.) is quantitatively related to the average of the fluctuations of the same observable inside 
a given sample (r.h.s.). This relation is very interesting because it is not satisfled in most of 
the non-stochastically stable models and it is very well satisfled in three dimensional models . 
An other relation of the same kind is: 

E{qUh) = \E{ql,f + \E{ql,) . (63) 

One could write an inflnite set of similar, but more complex sum rules. 

Stochastic stability is an highly non-trivial requirement (notice that the union of two 
stochastically stable systems is not stochastically stable). 

Therefore it is interesting to present here the simplest non trivial case of stochastically 
stable system, where all the overlaps are equal 

qa,^ = qo<qEA, Va,7 . (64) 
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In this case (which is usually called one-step replica-symmetry breaking) we have only to 
specify the the weight of each state that (as usually) is given by 

Wa oc exp(— /?Fo). (65) 

Let us consider the case where the joint probability of the F's is such that the F' are random 
independent variable: the probability of finding an F in the interval [F; F + dF] is given by 

p{F)dF . (66) 

The total number of states is infinite and therefore the function p{F) has a divergent integral. 
In this case it is easy to prove that stochastic stability implies that the function p must be of 
the form 

p{F) oc exp{(3mF) . (67) 

At this end let us consider the effect of a perturbation of strength e on the free energy of 
a state, say a. The unperturbed value of the free energy is denoted by F^. The new value of 
the free energy Ga is given by Ga = Fa + era where Tq, are identically distributed uncorrected 
random numbers. Stochastic stability implies that the distribution p{G) is the same as p{F). 
Expanding to second order in e we see that this condition leads to 

dp/dF oc d^p/dF^ . (68) 

The only physical solution is given by eq. (l67j) with an appropriate value of m. The parameter 
m must satisfy the condition m < 1, if the sum 

Y^expi-pFa) (69) 

a 

is convergent. 

We have seen that stochastic stability fixes the form of the function p and therefore connects 
in an inextricable way the low and the high free energy part of the function p. 
In this case an explicit computation show that the function P{q) is given by 

P{q) = m6{q - go) + (1 - m)6{q - qEA) ■ (70) 

It is interesting that the same parameter m enters both in the form of the function p{F) at 
large values of F and in the form of the function P{q) which is dominated by the lowest values 
of -F, i.e. those producing the largest ly's. This result is deeply related to the existence of only 
one family of stochastic stable systems with uncorrelated F's. 

This relation is interesting from the physical point of view, because one could argue that 
the off-equilibrium dynamics depends on the behavior of the function p{AF) at very large 
argument, and in principle it could be not related to the static property that depend on the 
function p for small values of the argument. However stochastic stability forces the function 
p{AF) to be of the form (1671) . in all the range of AF. Consequently the high F and low F 
behavior are physically intwined [T3] . 
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Stochastic stable distribution have remarkable properties, an example of it can be found in 
the appendix I, taken from j24j. 

Stochastic stability in finite dimensional system has many interesting applications. For 
example it is possible, by analyzing the properties of a single large system, to reconstruct the 
properties of the whole V{T>) averaged over the ensemble of systems to which the individual 
system naturally belong ES] : in a similar way the fluctuation dissipation relations tells us 
that we can reconstruct the P{q) function from the analysis of the response and the correlations 
during aging [13]. 



5.2 The first non trivial approximation 

We start by presenting here the first non trivial approximation, i.e. the so called one step 
replica symmetry breaking. Let us assume that the probability distribution of the descriptor 
is given by eqs. (|64l) and ( !67ll . We need to compute both the shift in free energy and joint 
probability distribution of the effective field and of the free energy. 

The computation goes as follows. We suppose that in the system with spins we have a 
population of states whose total free energies Fa are distributed (when Fa is not far from a 
given reference value F* that for lighten the notation we take equal to zero) as 

Xn{Fn) oc exp(/5mF^) . (71) 

When we add the new spin, we will find a value of the field h that depends on the state a. We 
can now consider the joint probability distribution of the new free energy and of the magnetic 
field. We obtain 

AfN+iiF, h) = J dhP^^^ih) J dFNMN{FN)6{F - F^ - AF{h)), (72) 

where Pq,^^{h) is the probability distribution of the effective magnetic field produced on the spin 
at 0, for a generic state and it is still given by dfigj^^{h). It is crucial to take into account that 
the new free energy will differs from the old free energy by an energy shift that is h dependent. 
If we integrate over F/v and we use the explicit exponential form for J\fN{F]\[) we find that 

J\fN+i{F, h) oc exp(/?mF) j dfig^^{h) exp(/?mAF(/i))) (73) 

oc exp(/5mF)P/v+i(^) • 
The probability distribution of the field at fixed value of the new free energy is given by 

PN+i{h) oc fig^^ih) exp{(3mAF{h))) = fig^^{h) cosh(/5/i)"^ . (74) 

It is clear that P/v+i(^) different from fiq^^ih) as soon as m 7^ 0. In this way we find the 
consistency equation of the replica approach for qea- 

^ Jdhfig^^jh) cosh(/3/i)"tanh(/3/i)^ 
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If we put everything together taking care of also the other terms coming for the renormal- 
ization of the j's we find 




(76) 



where we have used the notation qi at the place of of qea- 

This result is obtained in the case where go = 0. Otherwise we have 



Pfiqo, qi, m) = - (1 - m)ql - mq^) + 



(77) 



m / dfiggholn / d^iq^^q^{hi) cosh(/5(/io + hi) 



The value of the parameter and of the free energy can be found by solving the equations 



A few comments are in order: 

• The probability distribution of h at fixed value of the free energy of the spins system 
{Ps{h)) is not the probability distribution of h at fixed value of the free energy of the 

+ 1 spins system P/v+i(^): the two free energies differs by an h dependent addictive 
factor and they do not have a flat distribution (as soon as m 7^ 0). The probability 
distribution of /i at a fixed value of the free energy of the A^ spins system is Gaussian, 
but the probability distribution of h at fixed value of the free energy of the A^ + 1 spins 
system is not a Gaussian. 

• Only in the case were A/7v(F/v) is an exponential distribution, Af]y+i{F, h) factorizes into 
the product of an F and an h dependent factor and the M]si+i{F) has the same form of 
Mn{F). Self-consistency can be reached only in the case of an exponential distribution 
for Mn^Fn). This fact is a crucial consequence of stochastic stability. 

• The self consistency equations for the q do not fix the value of m. This is natural because 
m is an independent variational parameter and we must maximize over qo, qi and m. If 
one looks to the distribution of the metastable of having a free energy density higher that 
the ground state (problem that we cannot discuss here for reason of space [35l [36] ) one 
finds that the distribution of the free energies inside the metastable states is characterized 
by a different value of m than the ground state. In this different context the equation 
df /dm = determines which is the free energy of the metastable states that are true 
equilibrium states. 

If one analyze the solution of these equation one finds that the entropy is still negative at 
low temperature, but only by of a tiny amount and that the value of Bq in eq. fl27j) is smaller 
of a factor 9 with respect to the previous computation. We are on the write track, but we have 
not reached our goal. 



dqo dqi 




(78) 
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5.3 Ultrametricity 



Let us consider two generic spin configuration at equilibrium and let us use the label c to denote 
it and the label a to denote the state to which they belong. 

Their overlap satisfies the following properties (usually called one step replica symmetry 
breaking) : 

• If c = c' the overlap is equal to 1, 

• If c 7^ c', a = a' the overlap is equal to gi, 

• If c 7^ c', a 7^ a' the overlap is equal to go- 

We see that we have the beginning of an hierarchical scheme. It is clear that the simplest 
generalization will assume that states are grouped into clusters, that are labeled by 7 and the 
overlaps are given by 

• If c = c' the overlap is equal to 1, 

• If c 7^ c' , a = a' the overlap is equal to g2, 

• If c 7^ c', a 7^ a' and 7 = 7' the overlap is equal to qi. 

• \i d , a ^ a' and 7 7^ 7' the overlap is equal to go- 

This case is called two step replica symmetry breaking. 

In order to specify the descriptor of the system we have to define the probability distribution 
of the weight if's or equivalently of the free energy F's. 

The following ansatz is the only one compatible with stochastic stability [37j 



Sometimes one may consider the case where this condition is violated: in this case one speaks of an inverted 
tree. The physical meaning of this inverted tree is clarified in |41| : an inverted tree for metastable states is 
discussed in |40| . however the physical implications are less clear. It seems to me that there are some hidden 
properties that we do not fully understand. 



(79) 



p(F„) = exp(/?m2F„) p(F^) = exp(/?miF^) , 




(80) 



mi5{q - go) + (ma - mi)5(g - gi) + (1 - mi)5(g - ga) . 



(81) 
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The free energy as a more complex expression, that can be written as a 

- (1 - m2)ql + (m2 - mi)ql + nnql) + (82) 

/(/lo, ^i) = y"rf/ig2_g,(/i2) cosh(/5(/io + hi + h2)T^ . 

At the end progress has been done, the value of Aq in equation fl27|) is much smaller and the 
zero temperature entropy is nearly equal to zero (e.g. >S'(0) = —.003). The results are nearly 
consistent but not completely consistent. Moreover the zero temperature energy seems to be 
convergent: it was -.798 in the naive approach, -765 in the one step approach and -.7636 in the 
two step approach (the correct value is -.7633). 

It is clear that we can go on introducing more steps of replica symmetry breaking: at the 
third steps we will to assume that clusters are grouped into families, that are labeled by 5 and 
the overlaps are given by 

• If c = c' the overlap is equal to 1, 

• If c 7^ c' , a = a' the overlap is equal to gs, 

• If c 7^ c', a 7^ a' and 7 = 7' the overlap is equal to q2- 

• \i c ^ c' , a ^ a' , ^ 7' and 5 = 5' the overlap is equal to qi. 

• \i d , a ^ a', 7 =7^ 7' and 5^5' the overlap is equal to go- 
In the same way as before stochastic stability implies that 

Foj-fji Fa ~l~ F'f ~l~ F^ , 

p(F,) = exp(/3m3F„) , (83) 
p(F^) = exp(/5m2F-y) , 
p{Fs) = exp{pmiFs) , 

where we have 

mi < 7712 < ■ (84) 
In this case the function P{q) is given by 

mi5{q - qo) + im2 - mi)5{q ~ qi) + (85) 
(mg - m2)5{q - ^2) + (1 - 'ms)5{q - q^) 

This hierarchical construction of the probability distribution of the descriptor is called ultra- 
metric, because if we use the distance defined in eq. ( I36l) the following inequality holds [2|: 

da,/3 < max{da,'y, d-^^p) V7 (86) 
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If the the ultrametricity is satisfied, we can associate to the set of states a tree, formed 
by a root, by the nodes of the the tree and by the leaves are the states. States branching 
from the same node belongs to the same cluster. In the two step breaking all the nodes are 
the clusters. In the three step breaking the nodes are both the clusters and the families. In 
order from above we have the root, the families, the clusters and the states. In order to fix 
the probability distribution of the descriptor, we have to give the self distance of the states, 
the distance of the states belonging to the same clusters, the distance of the states belonging 
to different clusters, but to the same family, and the distance among the states belonging to 
different families [21 |42l |43j . As we have already remarked the probability distribution of the 
leaves is fixed by stochastic stability. 

At the present moment it is not rigorously know which of the following two alternatives are 
correct: 

• Ultrametricity is a necessary condition, i.e. a consequence of overlap equivalence and of 
stochastic stability, 

• Ultrametricity is an independent hypothesis. 

However there are strong arguments that suggest that the first statement is true [H] (although 
a rigorous proof is missing) and personally I am convinced that this is the case. 

The question if overlap equivalence (and consequently ultrametricity) is a consequence of 
stochastic stability it is a more difficult question. Opposite arguments can be presented: 

• The fact that there is no known example of a stochastically stable system where we can 
define two non-equivalent overlaps, can be considered a strong suggestion of the non- 
existence of such systems. 

• The construction of non-trivial stochastically stable system is rather difficult; in some 
sense it was done by chance using the algebraic replica method. It is likely that the 
construction of stochastically stable systems with two non-equivalent overlaps will be 
rather complex (if it is non-void) and it may take a very strong effort to exhibit an 
explicit case. 

It is clear that further research in this direction is needed: it would be very interesting to 
discover a stochastically stable systems with two non-equivalent overlaps. 

Generally speaking stochastic stability may have unexpected consequences: for example for 
a stochastically stable system (in the original sense p^[T6| [T7]). without doing any assumption 
on the decomposition into states, it is possible to prove |15] that the support of the function 
P{q) is discrete, i.e., if N is large, we can find n very small intervals such that the integral of 
the function P{q) outside these intervals goes to zero with n, at least as 

5.4 Continuos Symmetry Breaking 

From the discussion of the previous section is completely evident that we can go on and in- 
troduce more and more levels of symmetry breaking. The problem is how to control the limit 
where the number of levels is going to infinity. 
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At this end we can introduce the function q{x) on the interval [0 : 1] that is given by 



q{x) = qi if mi <x < rrii+i , (87) 

where the index / runs from zero to K and we have used the convention that mo = and 
rriK+i = 1- This function is interesting for many reasons. 

• In the case of i^-step symmetry breaking the function q{x) is piecewise constant and takes 
K + 1 values. 

• The inverse function x{q) is discontinuous (we assume that the g"s are increasing and we 
use the convention x(0) = 0). We have the very simple relation 

P(,) = I . (88) 



• In the limit K —>■ oo the function q{x) may become a continuos function and in this case 
we can speak of continuos replica symmetry breaking. 

• The limit ^ oo is rather smooth for any reasonable observable. 

From one side it is possible to construct in this way an infinite tree with branches at all 
the levels by a painful explicit construction. A priori it is not obvious that this construction 
has a well defined limit, however it is possible to check the all the properties of the tree can be 
computed and explicit formulae can be obtained [21 Il2l US], Il6j for all the possible quantities. 
It is possible to define this tree in a rigorous directly in the continuos limit [17] by stating the 
properties of resulting measure. 

It crucial that although branching may happens at any level, we can reduce ourself to 
consider trees with only a finite number of branches. Indeed the number of equilibrium states 
is diverging when the volume goes to infinity, but most of the states carry a very small weight 
(i.e. they are high free energy states). An explicit computation HS] shows that the total 
weight of the states with weight less than e goes to zero when e goes to zero, therefore removing 
an infinite number of states, that carry negligible weight, we remain with a finite number of 
them. 

In this construction one finds the the only free quantity is the function P{q) itself; its form 
determines analytically the full V(V) [H7] . 

The inequality fl86|) implies that the most relevant states form an ultrametric tree, i.e. they 
can be put on a tree in such a way that the states are on the branches of the tree and the 
distance among the states is the maximum level one has to cross for going from one states to 
an other. In other words the states of a system can be classified in a taxonomic way. The most 
studies possibilities are the following: 

• All different states are at given distance d one from the other and the taxonomy is rather 
trivial (one step replica symmetry breaking). 
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Figure 1: An example of a taxonomic tree of states in the case of an hierarchical breaking of 
the replica symmetry 

• The states have a continuous distribution and branching points exist at any level {con- 
tinuous replica symmetry breaking). A suggestive drawing of how the tree may look like, 
if we draw only the finite number of branches that have weight larger than e, is shown in 
fig. ([1]). A careful analysis of the properties of the tree can be found in [311 H3] . 

Other distributions are possible, but they are less common or at least less studied. 
5.5 The final result 

In order to compute the free energy is useful to write down a formula for its value that is valid 
also in the case where there is a finite number of steps. After some thinking, we can check 
that the following expression (189|) is a compact way to write the previous formulae for the free 
energy in terms of the function x{q) (or q{x)). The expression for the free energy is a functional 
(a functional of the function q[x]) and it is given by: 

PM^)] = X (l - ^'(^) dx) + /(O, 0) (89) 

where the function /(g, h) is defined in the strip < g < Qea = Ik+i and it obeys the non 
linear equation: 

/ = -(/" + x(g)(m , (90) 

where dots and primes mean respectively derivatives with respect to q and h. The initial 
condition is 

f{q,y) = cosh{PmKh) . (91) 

Now the variational principle tell us that the true free energy is greater than the maximum 
with respect to all function g(x) of the previous functional. It is clear that a continuos function 
may be obtained as limit of a stepwise continuos function and this shows how to obtain the 
result for a continuos tree in a smooth way 
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Talagrand [20] is using on a cleaver the generalization of the bounds by Guerra fTE] to 
systems composed by a two identical copies: he finally arrives to write also an upper bound 
for the free energy and to prove that they coincide. In this way after 24 years the following 
formula for the free energy of the SK model was proved to be true: 

/ = max/[g(x)] . (92) 

q{x) 

We have already remarked that the mathematical proof does not imply that the probability 
distribution of the descriptors is the one predicted by the physical theory. The main ingredient 
missing is the proof that the ultrametricity properties is satisfied. This is the crucial point, 
because ultrametricity and stochastic stability (which is known to be valid) completely fix the 
distribution. It is likely that the needed step would be to transform the estimates of [H] into 
rigorous bounds, however this is a rather difficult task. Maybe we have to wait other 24 years 
for arriving to the rigorous conclusion that the heuristic approach gave the correct results, 
although I believe that there are no serious doubts on its full correctness. 



6 Bethe lattices 

6.1 An intermezzo on random graphs 

It is convenient to recall here the main properties of random graphs [49] . 

There are many variants of random graphs: fixed local coordination number, Poisson dis- 
tributed local coordination number, bipartite graphs. . . They have the same main topological 
structures in the limit where the number (N) of nodes goes to infinity. 

We start by defining the random Poisson graph in the following way: given N nodes we 
consider the ensemble of all possible graphs with M = aN edges (or links). A random Poisson 
graph is a generic element of this ensemble. 

The first quantity we can consider for a given graph is the local coordination number Zi, i.e. 
the number of nodes that are connected to the node i. The average coordination number z is 
the average over the graph of the zf. 

z = . (93) 

In this case it is evident that 

z = 2a . (94) 

It takes a little more work to show that in the thermodynamic limit (A^ — > oo), the probability 
distribution of the local coordination number is a Poisson distribution with average z. 

In a similar construction two random points i and k are connected with a probability that is 
equal to z/{N — 1). Here it is trivial to show that the probability distribution of the Zi is Poisson, 
with average z. The total number of links is just zN/2, apart from corrections proportional to 
V^. The two Poisson ensembles, i.e. fixed total number of links and fiuctuating total number 
of links, cannot be distinguished locally for large N and most of the properties are the same. 
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Random lattices with fixed coordination number z can be easily defined; the ensemble is 
just given by all the graphs with Zi = z and a random graph is just a generic element of this 
ensemble . 

One of the most important facts about these graphs is that they are locally a tree, i.e. they 
are locally cycleless. In other words, if we take a generic point i and we consider the subgraph 
composed by those points that are at a distance less than d on the graph Ef], this subgraph is 
a tree with probability one when N goes to infinity at fixed d. For finite iV this probability is 
very near to 1 as soon as 

In(Ar) > A{z) d , (95) 

Ai^z^ being an appropriate function. For large N this probability is given by 1 — 0(1/A^). 

If z > 1 the nodes percolate and a finite fraction of the graph belongs to a single giant 
connected component. Cycles (or loops) do exist on this graph, but they have typically a 
length proportional to In(A^). Also the diameter of the graph, i.e. the maximum distance 
between two points of the same connected component is proportional to In(A^). The absence of 
small loops is crucial because we can study the problem locally on a tree and we have eventually 
to take care of the large loops (that cannot be seen locally) in a self- consistent way. i.e. as a 
boundary conditions at infinity. 

Before applying the problem will be studied explicitly in the next section for the ferromag- 
netic Ising model. 

6.2 The Bethe Approximation in D=2 

Random graphs are sometimes called Bethe lattices, because a spin model on such a graph can 
be solved exactly using the Bethe approximation. Let us recall the Bethe approximation for 
the two dimensional Ising model. 

In the standard mean field approximation, one writes a variational principle assuming the all 
the spins are not correlated [5]; at the end of the computational one finds that the magnetization 
satisfies the well known equation 

m = th(/5J2;m) , (96) 

where 2; = 4 on a square lattice (z = 2d'm. d dimensions) and J is the spin coupling (J > 
for a ferromagnetic model). This well studied equation predicts that the critical point (i.e. the 
point where the magnetization vanishes) is /3c = This result is not very exiting in two 

dimensions (where /3c ~ -44) and it is very bad in one dimensions (where /3c = 00). On the 
other end it becomes more and more correct when c? — 00. 

A better approximation can be obtained if we look to the system locally and we compute 
the magnetization of a given spin (a) as function of the magnetization of the nearby spins (tj, 
i = 1, 4). If we assume that the spins r are uncorrelated, but have magnetization m, we obtain 
that the magnetization of the spin a (let us call it mo) is given by: 

T i=l,4 

^■^The distance between two nodes i and k is the minimum number of links that we have to traverse in going 
from i to fc. 
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where 

1 _|_ 1 — 

Pm[r] = n Prnin), Pm{T) = ^^^r,! + ^r,-! • (98) 

i=l,4 

The sum over all the 2^ possible values of the r can be easily done. 
If we impose the self-consistent condition 

mo(m) = m , (99) 

we find an equation that enables us to compute the value of the magnetization m. 

This approximation remains unnamed (as far as I know) because with a little more work we 
can get the better and simpler Bethe approximation. The drawback of the previous approxima- 
tion is that the spins r cannot be uncorrelated because they interact with the same spin a: the 
effect of this correlation can be taken into account ant this leads to the Bethe approximation. 

Let us consider the system where the spin a has been removed. There is a cavity in the 
system and the spins r are on the border of this cavity. We assume that in this situation these 
spins are uncorrelated and they have a magnetization mc- When we add the spin cr, we find 
that the probability distribution of this spin is proportional to 

^P„,^[r])exp(/3Ja5:rJ . (100) 

r \ i=l,4 / 

The magnetization of the spin cr can be computed and after some simple algebra we get 

m = th{z arth[th(/3 J)mc]} , (101) 

with z — A:. 

This seems to be a minor progress because we do not know m,c- However we are very near 
the final result. We can remove one of the spin and form a larger cavity (two spins removed). 
If in the same vein we assume that the spins on the border of the cavity are uncorrelated and 
they have the same magnetization mc, we obtain 

mc = th{(^ - l)arth[th(/3 J)mc]} . (102) 

Solving this last equation we can find the value of mc and using the previous equation we can 
find the value of m. 

It is rather satisfactory that in 1 dimensions {z — 2) the cavity equations become 

mc = th(/3J)mc . (103) 

This equation for finite /3 has no non-zero solutions, as it should be. 

The internal energy can be computed in a similar way: the energy density per link is given 

by 

_ th(/3 J) + ml 

- 1 + ihmmi ■ 

We can obtain the free energy by integrating the internal energy as function of (3. 
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In a more sophisticated treatment we write the free energy as function of mc'- 

(3F{rnc) ^ Fsite{mc) - ^Funkimc) , (105) 

where Funkiriic) and FsUeimc) are appropriate functions [50]. This free energy is variational, 
in other words the equation 

dF 

(106) 



dmc 

coincides with the cavity equation 



6.3 Bethe lattices and replica symmetry breaking 

It should be now clear why the Bethe approximation is correct for random lattices. If we remove 
a node of a random lattice, the nearby nodes (that were at distance 2 before) are now at a very 
large distance, i.e. 0(ln(A^)). In this case we can write 

{n^Ti^) ^ mi^rrii^ (107) 

and everything seems easy. 

This is actually easy in the ferromagnetic case where in absence of magnetic field at low 
temperature the magnetization may take only two values (±m). In more complex cases, (e.g. 
antiferromagnets) there are many different possible values of the magnetization because there 
are many equilibrium states and everything become complex (as it should) because the cavity 
equations become equations for the probability distribution of the magnetizations [2]. 

I will derive the TAP cavity equations on a random Bethe lattice [281 EH EHl |5T] where 
the average number of neighbors is equal to z and each point has a Poisson distribution of 
neighbors. In the limit where z goes to infinity we recover the SK model. 

Let us consider a node i; we denote by di the set of nodes that are connected to the point 
i. With this notation the Hamiltonian can be written 

H=WT.J^M^Mk). (108) 

^ i kedi 

We suppose that for a given value of the system is in a state labeled by a and we suppose 
such a state exists also for the system of — 1 spins when the spin i is removed. Let us call 
m{i)a the magnetization of the spin k and m(fc; i)a the magnetization of the spin k when the 
site i is removed. Two generic spins are, with probability one, far on the lattice: they are at an 
average distance of order In(A^); it is reasonable to assume that in a given state the correlations 
of two generic spins are small (a crucial characteristic of a state is the absence of infinite-range 
correlations). Therefore the probability distribution of two generic spins is factorized (apart 
from corrections vanishing in probability when A^ goes to infinity) and it can be written in 
terms of their magnetizations. 

We have already seen that the usual strategy is to write the equation directly for the cavity 
magnetizations. We obtain (for I G di): 

m(i; Z) = tanh ^ artanh(tanh(/3Jj^fc)'^(^; 0) ■ (109) 

\kedi;k=^l J 
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Following this strategy we remain with Nz equations for the Nz cavity magnetizations m(i; /c); 
the true magnetizations {rn{i)) can be computed at the end using equation (11091) . 

In the SK limit (i.e. z ~ A^), it is convenient to take advantage of the fact that the J's are 
proportional to A^~^/^ and therefore the previous formulae may be partially linearized; using 
the the law of large numbers and the central limit theorem one recovers the previous result for 
the SK model. 

It is the cavity method, where one connects the magnetizations for a system of spins 
with the magnetizations for a system with — 1 spins. In absence of the spin i, the spins <j{k) 
{k G di) are independent from the couplings Ji^k- 

We can now proceed exactly as in SK model. We face a new difficulty already at the replica 
symmetric level: the effective field 

^e// = XI artanh (tanh(/3Jj^fc)m(A;; i)) (110) 

is the sum of a finite number of terms and it no more Gaussian also for Gaussian J's. This 
implies that the distribution probability of hf.ff depends on the full probability distribution of 
the magnetizations and not only on its second moment. If one writes down the equations, one 
finds a functional equation for the probability distribution of the magnetizations (P(m)). 

When replica symmetry is broken, also at one step level, in each site we have a probability 
distribution of the magnetization over the different states Q{m) and the description of the prob- 
ability distribution of the magnetization is now given by the probability distribution P[Q{m)], 
that is a functional of the probabilities Q{m) [2l[ [25], [511 [521 [53] . 

The computation becomes much more involved, but at least in the case of one step replica 
breaking (an sometimes at the two steps level) they can be carried up to the end. The one 
step approximation is quite interesting in this context, because there are optimization models 
in which it gives the exact results [521 [Ej. A complete discussion of the stability of the one 
step replica approach can be found in [5^ . 

7 Finite dimensions 
7.1 General considerations 

It is well known that mean field theory is correct only in the infinite dimensional limit. Usually 
in high dimensions it gives the correct results. Below the upper critical dimensions (that is 6 
in the case of spin glasses) the critical exponents at the transition point change and they can 
be computed near to the upper critical dimensions using the renormalization group. 

Sometimes the renormalization group is needed to study the behavior in the low temperature 
phase (e.g. in the 0{n) spin models), if long range correlations are present. A careful and 
complete analysis of spin glasses in the low temperature phase is still missing due to the 
extreme complexity of the corrections to the mean field approximation. Many very interesting 
results have been obtained [55], but the situation is still not clear. May be one needs a new 
approach, e.g starting to compute the corrections to mean field theory at zero temperature. 

There are two different problems that we would like to understand much better: 
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• The value of the lower critical dimension. 

• If the predictions of the mean field theory at least approximately are satisfied in three 
dimensions 

These two problems will be addressed in the next two sections 
7.2 The lower critical dimension 

The calculation of free energy increase due to an interfaces is a well known method to compute 
the lower critical dimension in the case of spontaneous symmetry breaking. I will recall the 
basic points and I will try to apply it to spin glasses. 

Generally speaking in the simplest case wc can consider a system with two possible coexisting 
phases {A and B), with different values of the order parameter, 

For standard ferromagnets we may have ; 

• A: spins up. 

• B: spins down. 

We will study what happens in a finite system in dimensions D of size M'' L with d — D — 1. 

We put the system in phase A at z — and in phase B at z — L. The free energy of the 
interface is the increase in free energy due to this choice of boundary conditions with respect 
to choosing the same phase at z = and z = L. In many cases we have that the free energy 
increase 6F{M, L) behaves for large M and L as: 

6F{L,M) ^ M'^/L'^ , (111) 

where u is independent from the dimension. 

There is a lower critical dimension where the free energy of the interface is finite: 

Dc = uJ + l, (112) 

and 

SF{L, L) = . (113) 

Heuristic arguments, which sometimes can be made rigorous, tell us that when D = cj + 1, 
(the lowest critical dimension) the two phases mix in such a way that symmetry is restored. 

In most cases the value of uj from mean field theory is the exact one and therefore we can 
calculate in this way the value of the lower critical dimension. The simplest examples are the 
ferromagnetic Ising model a; = and the ferromagnetic Heisenberg model uj — 1. 

For spin glasses the order parameter is the overlap q and all values of q in the interval 
[—<1ea-i (Iea\ are allowed. We consider two replicas of the same system described by a Hamilto- 
nian: 

H = H[a] + H[t] , (114) 
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where H is the Hamiltonian of a a single spin glass. We want to compute the free energy 
increase corresponding to imposing an expectation value of q equal to gi at z = and q2 at 
z = L. 

A complex computation gives (for small \qi — q2\) 

6F oc ML(|gi - gal/^)'/' oc L^^-^/^) _ (^^5^ 

As a consequence, the naive prediction of mean field theory for the lower critical dimension for 
spontaneous replica symmetry breaking is = 2.5. I stress that these predictions are naive; 
corrections to the mean field theory are neglected. In known cases these kind of computations 
give the correct result, 

A direct check of this prediction has never been done, however it quite remarkable that 
there are numerical results that strongly suggest that the lower critical dimension is really 2.5. 
Indeed a first method based on finding the dimension where the transition temperature is zero 
[56| [57] . gives Dc = 2.491. A more accurate method based on interpolating the value of a 
critical exponent [57] gives 

= 2.4986 , (116) 

with an error of order 10~^ (my estimate). 

It seem that this prediction for the lower critical dimension is well satisfied. It success 
implies that tree dimensional systems should be describe in the low temperature phase by the 
mean field approximation, although the correction could slowly vanish with the system size 
and the critical exponents could be quite different from the naive one, due to the fact three 
dimensions are only 0.5 dimensions above the lower critical dimensions. What happens in three 
dimension will be discussed in the next section. 

7.3 The three dimensional case 

Let us describe some of the equilibrium properties that has be computed or measured in the 
there dimensional case. We have to make a very drastic selection of the very vast literature, 
for a review see P, ES] • 

All the simulations done with systems up 24^ [59j find that at low temperature at equilibrium 
a large spin glass system remains for an exponentially large time in a small region of phase 
space, but it may jump occasionally in a relatively short time to an other region of phase 
space (it is like the theory of punctuated equilibria: long periods of stasis, punctuated by fast 
changes). Example of the function Pj{q), i.e. the probability distribution of the overlap among 
two equilibrium configurations, is shown in fig. ([2]) for two three dimensional samples. 

We have defined P{q) = Pj{q), where the average is done over the different choices of the 
couplings J, see fig. ([3]). We have seen that average is needed because the theory predicts (and 
numerical simulations also in three dimensions do confirm) that the function Pj{q) changes 
dramatically from system to system. It is clear that the function remains non-trivial in the 
infinite volume limit. 

In the mean field approximation the function P{q) (and its fluctuations from system to 
system) can be computed analytically together with the free energy: at zero magnetic field 
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Figure 2: The function Pj{q) for two samples (i.e two choices of J) for D = 3, L = 16 (16^ 
spins) from [58| . 




P{q) has two delta functions at ^Qea, with a flat part in between. The shape of the three 
dimensional function P{q) is not very different from the one of the mean fields models. 

The validity of the sum rules derived from stochastic stability (eqs. fl61|63p ) has been rather 
carefully verified [6|. This is an important test of the theory because they are derived in the 
infinite volume limit and there is no reason whatsoever that they should be valid in a finite 
system, if the system would be not sufficient large to mimic the behavior of the infinite volume 
system. There are also indication that both overlap equivalence [32l [33] and ultrametricity 
[571 EB] are satisfied, with corrections that goes to zero slowly by increasing the system size. 

Very interesting phenomena happen when we add a very small magnetic field. They are 
very important because the magnetic properties of spin glass can be very well studied in real 
experiment. 

From the theoretical point of view we expect that order of the states in free energy is 
scrambled when we change the magnetic field their free energies differ of a factor 0(1) 
and the perturbation is of order A^. Different results should be obtained if we use different 
experimental protocols: 

• If we add the field at low temperature, the system remains for a very large time in the 
same state, only asymptotically it jumps to one of the lower equihbrium states of the new 
Hamiltonian. 

• If we cool the system from high temperature in a field, we likely go directly to one of the 
good lowest free energy states. 

Correspondingly there are two susceptibilities that can be measured also experimentally: 

• The so called linear response susceptibility Xlr, i-e. the response within a state, that is 
observable when we change the magnetic field at fixed temperature and we do not wait 
too much. This susceptibility is related to the fluctuations of the magnetization inside a 
given state. 
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Figure 3: The function P{q) = Pj{q) after average over many samples (L=3. . . 10) from [60j . 

• The true equilibrium susceptibility, Xeq, that is related to the fluctuation of the magne- 
tization when we consider also the contributions that arise from the fact that the total 
magnetization is slightly different (of a quantity proportional to \/N) in different states. 
This susceptibility is very near to Xfc, the field cooled susceptibility, where one cools the 
system in presence of a field. 

The difference of the two susceptibilities is the hallmark of replica symmetry breaking. In 
fig. (jl]) we have both the analytic results for the SK model |2j and the experimental data on 
metallic spin glasses [61]. The similarities between the two panels are striking. 

Which are the differences of this phenomenon with a well known effect; i.e. hysteresis? 

• Hysteresis is due to defects that are localized in space and produce a finite barrier in free 
energy. The mean life of the metastable states is finite and it is roughly exp(/3AF) where 
AF is a number of order 1 in natural units. 

• In the mean field theory of spin glasses the system must cross barriers that correspond to 
rearrangements of arbitrary large regions of the system. The largest value of the barriers 
diverge in the thermodynamic limit. 

• In hysteresis, if we wait enough time the two susceptibilities coincide, while they remain 
always different in this new framework if the applied magnetic field is small enough (non 
linear susceptibilities are divergent). 

The difference between hysteresis and the this new picture (replica symmetry breaking) 
becoming clearer as we consider fluctuation dissipation relations during aging [TOl [HI [12], [TSj 
[69l [70] , but this would be take to far from our study of equilibrium properties. 
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Figure 4: The two susceptibilities; upper panel, the analytic results in the mean field approxi- 
mation [2j; lower panel, the experimental results for a metallic spin glass [61] 

8 Some other applications 

Some of the physical ideas that have been developed for spin glasses have also been developed 
independently by people who were working in the study of structural glasses. However in the 
fields of structural glasses there were no soluble models that displayed interesting behavior so 
most of the analytic tools and of the corresponding physical insight were firstly developed for 
spin glasses (for a review see for example [22] )• 

The two fields remained quite separate one from the other also because there was a widespread 
believe that the presence of quenched disorder (absent in structural glasses) was a crucial in- 
gredient of the theory developed for spin glasses. Only in the middle of the 90 's it became clear 
that this was a misconception [711 [H] and it was realized that the spin glass theory may be 
applied also to systems where non- intrinsic disorder is present (e.g. hard spheres). 

This became manifest after the discovery of models where there is a transition from a 
high temperature liquid phase to a low temperature glassy phase (some of these models at low 
temperature have two phases, a disorder phase and an ordered, crystal phase). Spin glass theory 
was able to predict the correct behavior both at high and at low temperature [TH [72], [73] . 

There are many other problems where these ideas have been used. In the past there has been 
a great interest in applying them to problems with a biological fiavor, like the computation of 
the optimal performance of associative memories based on neural networks [74J. Also learning 
abilities of simpler objects like the perceptrons can be computed. 

In recent years they have been widely used in the field of combinatorial optimization prob- 
lems and constraint satisfaction, but this will be discussed elsewhere in this volume |14] . 

9 Conclusions 

From the retrospective point of view it may seem extraordinary the amount of new ideas that 
has been necessary in order to understand in depth the basic properties of spin glasses and other 
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glassy system. A strong effort should be done in order to have better quantitative predictions 
and a more precise comparison between theory and experiments. 

I ma convinced that there are still many very interesting surprises that will come from a 
careful study of spin glasses (and related problem) and it is quite likely that the most exciting 
result will come from an area I am not able to indicate. I am very curious to see the future of 
the field. 



Appendix I: A useful little theorem 

In this appendix we want to prove a useful little theorem [21], which may be useful in many 
contests. 

Theorem: consider a set of M(:^ 1) iid random free energies /„, (a e {1 . . . M}) distributed 
with the exponential density eq. fl67j) , and a set of M positive numbers a^. Then, neglecting 
terms which go to zero when M goes to infinity, the following relation holds: 

/ E.a.exp(-/3/) \ ^^^^^ 



E^exp (-/?/< 
^(ln(E^.a.))/ = ^ln(^Ea: 



where (■)/ denotes an average over the distribution of /. 

Corollary 1: In the same conditions as the theorem, for any set of M real numbers ha-, one 

has: 

/Eaaa&aexp(-/5/c,)\ E 

\ EaaaeXp(-/?/„) I ^ EaK 

Corollary 2: If the numbers are M iid positive random variables, such that the average 
of exists, which are uncorrelated with the fa, then one has: 

where {■)a denotes an average over the distribution of a. 

Remark: We notice that in the two limits x ^ and x — > 1 the equations can be simply 
understood: 

• In the limit x = 0, in a typical realization of the random free energies, only one weight w 
is equal to one and all the others are zero. Averaging over the realizations of free energies 
amounts to spanning uniformly the set of indices of this special non zero weight. 

• In the limit x = 1 the number of relevant w goes to infinity and each individual contri- 
bution goes to zero. An infinite number of term is present in the l.h.s. of eq. (11181) and 
the r.h.s. of the eq. (11181) becomes In [(1/M) J2a (^a], as it should. 
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